Pathwise Duals of Monotone and Additive Markov Processes
نویسندگان
چکیده
منابع مشابه
Markov control processes with pathwise constraints
This paper deals with discrete-time Markov control processes in Borel spaces, with unbounded rewards. The criterion to be optimized is a long-run samplepath (or pathwise) average reward subject to constraints on a long-run pathwise average cost. To study this pathwise problem, we give conditions for the existence of optimal policies for the problem with “expected” constraints. Moreover, we show...
متن کاملLinear Additive Markov Processes
We introduce LAMP: the Linear Additive Markov Process. Transitions in LAMP may be influenced by states visited in the distant history of the process, but unlike higher-order Markov processes, LAMP retains an efficient parameterization. LAMP also allows the specific dependence on history to be learned efficiently from data. We characterize some theoretical properties of LAMP, including its stead...
متن کاملOn Markov-Additive Jump Processes
In 1995, Pacheco and Prabhu introduced the class of so–called Markov–additive processes of arrivals in order to provide a general class of arrival processes for queueing theory. In this paper, the above class is generalized considerably, including time–inhomogeneous arrival rates, general phase spaces and the arrival space being a general vector space (instead of the finite–dimensional Euclidea...
متن کاملMarkov Property of Monotone Lévy Processes
Monotone Lévy processes with additive increments are defined and studied. It is shown that these processes have natural Markov structure and their Markov transition semigroups are characterized using the monotone Lévy-Khintchine formula. 17 Monotone Lévy processes turn out to be related to classical Lévy processes via Attal's " remarkable transformation. " A monotone analogue of the family of e...
متن کاملPathwise Smoothing of Markov Processes with Noisy Observations
Since the advent of the Feynman-Kac formula (8, 9, 171, the connections between function space integrals arising in probability theory and partial differential equations has been a field of active research. Recently, such connections have found applications in stochastic filtering theory [2, 12-14 ]. A prototypical estimation problem for random processes can be described as follows: Given a sig...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Theoretical Probability
سال: 2016
ISSN: 0894-9840,1572-9230
DOI: 10.1007/s10959-016-0721-5